Skip to content

Junya Yang | Academic Homepage

Main Navigation Home Research Projects Blog Tags Archive Friends

Compiler Construction

Computer Graphics

Computer Organization

Computer Network

Database Management System

Functional Programming

Operating System

Theory Of Computation

Appearance

Sidebar Navigation

Algorithm

Basic Algorithm

Basic-Algorithm-overview

Binary Search

Discretization

Sliding Window

DAA

Algorithm

Divide-and-Conquer

[[Enumeration]]-subset

Enumeration

Graph-algorithm

Sort

Union-Find

Tutorial

Tutorial-1

assignment

DAA-Assignment-0

DAA-Assignment-1

DAA-Assignment-2

DAA-Programming-Assignment

DSA

Assignment

DSA-AS-1

DSA-AS-am

DSA-As-2

$B^+\ Tree$

DSA - AVL Trees

DSA-Algorithm Analysis

DSA-B+ Tree

DSA-[[Binary Search]] Tree

Tree

Fenwick

DSA-Heap Sort

Priority-Queue

DSA-Quick Sort

Graph

Graph-Overview

Number Theory

Prime-Sieve|质数筛

Recursion

Recursion-[[DSA-BinaryTree]]

递归

递推

STRING

Manacher Algorithm

Bayesian Network

Assignment

BN-Assignment-1

BN-Assignment-2

Lecture

Bayesian NetworkProbability Theory

Bayesian Network Representation

Bayesian Network Variable Elimination

Bayesian Network Clique Tree

Bayesian Network Parameter Learning

Bayesian Network Structure Learning

Bioinformatics

Assignment

As-1

Bioinfo-Assignment-1

Homology_Protein

Program: needle

As-2

Bio-As-2

Bioinfo Matrix Operations

Bioinformatics-Review

Bioinfo-Network

Bioinfo-Project

Bioinformatics Overview

Lab

Lab-1

Bioinfo-Lab-1

Program: needle

Lab-2

Lab-3

Bioinfo-Lab-3

Lab-4

Bioinfo-Lab-4

Compiler Construction

Assignment

Compiler-As-1

Compiler-As-2

Compiler-As-3

Lecture

Compiler Introduction

Compiler Lexical Analysis

Compiler Syntax Analysis

Compiler Semantic Analysis

Compiler-Intermediate Code Generation & Code Optimization

Compiler-Solution for First set, Follow set and LL(1) Parsing table

For LR Parsing Algorithm, LR(0) items, SLR Parsing Table Construction

Project

Compiler Project Language Features

Computer Graphics

Assignment

CG-Assignment-1

CG-Assignment-2

CG-Assignment-3

CG-Overview

[[CG-Overview|CG-Review]] List

Lecture

Computer Graphics-Shading

Computer Graphics-Texture Mapping

Computer Graphics-Curves

Computer Graphics-Clipping

Computer Graphics-Rasterization

Computer Graphics-Raycasting

GAMES101

CG-Math-Review

CG-Modeling Transformation

CG-Viewing Transformation

CG-Rasterization

05-CG-Shading

CG-Geometry

Computer Network

Assignment

DCN-Assignment1

Computer Network Overview

Lecture

Basic Concepts

Physical Layer

Data Link Layer

Network Layer

Transport Layer

Standardized Networks

DCN Review

USTC L1

Project

Chat-Application

Computer Organization

Assignment

Assignment-1

Assignment-2

CO-Assignment-2

Assignment-3

CO-Assignment-3

Assignment-4

CO-Assignment-4

Computer Organization Overview

Lab

CO-Lab2

CO-Lab3

CO-Lab5

CO-Lab6

CO-Lab7

CO-Lab8

Lecture

What is a Computer

Bits Data Representation and Manipulation

Boolean-Algebra-from-Bits-to-Logic

From-Transistors-to-Gates

From-Gates-to-Circuits-I-Combinational-Circuits

From-Gates-to-Circuits-II-Sequential-Circuits

Circuit-Design

Finite-State-Machine

Microarchitecture

ISA

From-Machine-Language-to-Assembly-Language

Computer Vision

Assignment

Lab Report: Image Processing with 2D Discrete Fourier Transform (DFT) and Inverse DFT

Lab Report: Digit Classification Using [[Deep Learning]] Architectures

Lab Report: [[CV-Object Detection|Object Detection]] Task Using LGG Dataset

CV-Project-Report

CV-Project

Computer Vision Overview

Homework

CV-HW-1

CV-HW-2

CV-HW-3

Lecture

CV-Attention

CV-Back Propagation

CV-Convolutional and image filtering

Fourier Transformation

CV-Generate Model

Image Pyramid

CV-Neural Network

Normalization Methods

CV-Object Detection

Signal and Image Processing

Weight Initialization

Data Analysis

Big Data Analysis

BDA-Review

Lab

BDA-Lab-1

BDA-[[Bioinfo-Lab-2|Lab-2]]

BDA-Lab-3

Lecture

Advertising

BFR Algorithm

BDA-DGIM

BDA-Find Similar Items

Link analysis

Map Reduce

BDA-Stream Data

Peoject

BDA-Project-Report

Predicting Movie Box Office with Causal Inference and Machine Learning

BDA-Survey

Data Visualization

DV-01-Introduction

DV-02-Data

DV-03-Perception and Principles

DV-04-Data Mapping

DV-05-Color Vision

DV-06-Designe Principles

DV-07-Basic Charts

DV-08-High Dimensional

DV-09-Interaction

DV-10-Geospatial Visualisation

[[DV-04-Data Mapping]]

Hands on Data Analysis

Hands On Data Analysis For Everyone

Database Management System

Application

MySQL+[[Redis]]

Assignment

NoSQL-Assignment-1

[[NoSQL-As-1|NoSQL-Assignment]]-2

RDBMS-Assignment-1

RDBMS-Assignment-2

RDBMS-Assignment-3

MySQL

Basic-MySQL

Cross-table-Query

Join

Aggregation

Data-Definition

Data-Modification

Null-Subquery

Set-Operation-&-Where-Subquery

Division-and-Correlated-Subquery

Advanced-SQL

NoSQL

Cassandra

MongoDB

Neo4j

NoSQL-Review

NoSQL

Redis

RDBMS

Entity-Relationship-Model-Modeling

Entity-Relationship-Model-Constraints

Entity-Relationship-Model-Extended-Features

Design-Issues

Logical-Design

Key-Concept

Relational-Database-Design-Purpose-&-First-Normal-Form

Relational-Database-Design-Functional-Dependency

Relational-Database-Design-BCNF

Relational-Database-Design-3rd-Normal-Form

Courier Station Information Management System

Final Review

Deep Learning

00-Basic

Activation Function

Dropout

Gradient Descent

K Cross Verified

Loss Function

Overfitting and Underfitting

Softmax and Argmax

01-Linear Regression

Basic torch

02-SoftMax Regression

Softmax Regression

03-Multiple Layer Perceptron

MLP

Deep Learning

Parameter-Efficient Fine-Tuning

NLP

Attention

BERT

Prompting Engineering Techniques

Prompting and In Context Learning

Functional Programming

Assignment

FP-As-1

Lecture

01-FP-Basics

03-FP-Function

05-FP-Higher-Order Functions

Graph Neural Network

Common GCN Layer

PyG-QuickStart

Machine Learning

Assignment

ML-As-1

ML-As-2

ML-As-3

ML-As-4

ML-As-5

Lecture

Bayesian Estimation

ML-Cluster Distance Measure

Cross Validation

ML-Density Estimation

Dimensionality Reduction

ML-Distance Measure

ML-Evaluation of Classifiers

ML-Expectation Maximization

ML-Hierarchical Clustering

ML-K Means

ML-Mean Shift Algorithm

Navie Bayes

Probability Perspective and Bayesian Perspective

ML-Regression

ML-SVM

Statistical Learning

ML-Cheat-Sheet

ML-Review

Machine Learning Overview

Project

Comment Filtering System

pre

Numerical Computation

Assignment

Numerical Computation Assignment 1

Numerical-Computation-As-2

Lecture

Numerical Computation Fundamentals

Numerical Computation Solving Equations

Numerical Computation Systems of Equations

Numerical Computation Interpolation

Numerical Differentiation and Integration

Numerical Computation Project

Numerical Computation Review

Operating System

Extend

Linux Basic Operation

NJU OS PA0

Lecture

Operating System Introduction

Operating System Structure

Process

Threads

CPU Scheduling

Process Synchronization

Main Memory

Virtual Memory

File System Interface

File System Implementation

Research

BioInfo

AlphaFold2

CSCN

CSN & cCSN & PC

CellSigFlow : 基于流的细胞间通信优化框架

Network Deconvolution

[[Network Deconvolution]]

Ploidy

Calculate Structure Entropy

[[Ploidy]] Review

Ploidy

CoT

CoT-Decoding

CoT Individual Report Script

Exploring Chain of Thought Techniques

CoT-Reading-List

DataBase

MySQL and NoSQL database comparison for IoT application

SP-HyperDecoder

Software Engineering

Assignment

SE-As-3

SE-As-4

Lecture

SE-Design and Implementation

SE-Software Process Model

SE-Specification

SE-Validation

Theory Of Computation

Assignment

TOC-As-1

TOC-As-2

TOC-As-3

Lecture

TOC-Intro

TOC-Math

TOC Finite Automata

TOC-Regular language

TOC-Pumping Lemma

TOC-Context Free Language

TOC-PDA

TOC-Turing Machine

TOC-Church-Turing Thesis and TM Variants

TOC-Universal Turing Machine

TOC-Undecidability and Reducibility

Tools

Conda

Docker

Docker快速部署OCaml支持的Jupyter Notebook

Docker

Git

Git-For-Beginners

Git-Introduction

Github

Git-Tip

Git-Workflow-Model

Regex

Regular-Expression

Shell

Web

CSS

CSS-Introduction

Vue

Vue-Application

Vue-Basic

javascript

Javascript-Quick-Start

On this page

PostDeep Learning / NLP

Bert

2024-07-07

Back to Blog

BERT

Bidirectional Encoder Representations from Transformers

Help me polish the article

Pager

Previous pageAttention

Next pagePrompting Engineering Techniques

Algorithm

Tutorial

assignment

Assignment

As-1

As-2

Lab-1

Lab-2

Lab-3

Lab-4

GAMES101

Assignment-1

Assignment-2

Assignment-3

Assignment-4

Lab

Lecture

Peoject

CSCN

Ploidy

Bert

BERT ​

BERT